METHOD AND SYSTEM OF CONTINUOUSLY 
SCALING VIDEO IMAGES 



Field of the Invention 

This invention relates to the field of video 
displays, and more particularly, this invention relates 
to scaling video images on a video display. 

Background of the Invention 

Increasing numbers of video game systems have 
built-in three-dimensional audio processors, a 
three-dimensional graphics processor unit (GPU) , a high 
speed central processing unit (CPU) with high speed bus 
transfer rates, built-in hard drives, and a large 
megabyte unified memory. Typically included in these 
video game systems are various types of removable 
memory cards, custom game controller ports, HDTV ports, 
expansion card ports, and often, a built-in DVD 
(digital versatile/video disc) player with the 
appropriate DVD software drivers for drawing the 
apparatus. Examples of such systems include various 
video games from Sony Corporation, such as the Play 
Station 2, the Nintendo Game Cube, and the XBox game 
system from Microsoft Corporation. For example, the 
XBox game system includes a front loading DVD tray 
operative with the DVD player and software drivers, 
four game controller ports to allow mult i -player gaming 
and ports for allowing connection of other peripherals, 
including game pads and voice-activated headsets. This 
system also includes an Ethernet port for broadband 
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connection, a NVIDIA graphics processing unit (GPU) , an 
Intel 733 MHz processor, and an internal hard drive. 

In some prior art video game systems, and in 
many consumer DVD players, any scaling or zooming of 
5 images has been provided as a "stepped" zoom 

functionality that is typically accomplished by 
pressing a zoom button. Once the zoom button is 
pressed, several different zooming functions can 
follow. For example, in a first zooming function, the 
10 current view is magnified twice or by some other 

arbitrary resolution. For example, if one is viewing 
E b 720x480 pixels of source content on a 720x480 display, 

p and a viewer hits "zoom," the viewer then views 360x240 

n 

tf pixels of source content, scaled to fit on a 720x480 

\ %~ 

M. 15 video display. Any sequential pressing of the zoom 

fli 

1J: button increments the zoom level by the same arbitrary 

W magnification level. In yet another zooming function, 

a pan-able bracket [] is displayed on the monitor 
screen or other video display and designates an area 
pj 20 that will be zoomed to full screen upon the next 

"ENTER" button depression. This type of "zooming" 
method and function also increases the magnification 
level by a fixed arbitrary amount. One of the 
drawbacks of this type of prior art system is that it 
25 does not allow a user to pan a zoomed image in 

"real-time" and does not provide a user with the means 
to increase or decrease the zoom level in a perceptibly 
continuous fashion . 

3 0 Summary of the Invention 

The present invention advantageously provides 
a method of scaling images continuously on a display 
for continuous zooming functions. In one aspect of the 
present invention, video data is generated as a video 
35 data stream and displayed on a video display at a 
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predetermined aspect ratio. During playback or in a 
pause mode, video source values of pixel width and 
pixel height to be displayed are obtained. The 
smallest integer increment on the x/y axis that will 
5 maintain the desired aspect ratio is determined by 

using a greatest common denominator to reduce the ratio 
to the lowest integer. 

The video data stream can be generated from a 
DVD (digital versatile/video disc) player or as a high 
10 definition television (HDTV) signal . It is possible to 
manipulate a joystick for initiating the zooming 
function and scale images on the video display. The 
joystick could be moved up to increase zoom 
magnification by a predetermined number of pixels or 
15 moved down to decrease zoom magnification by a 

predetermined number of pixels until fully zoomed out. 
A second joystick could be manipulated to vary the x/y 
position of the zoomed region in a continuous fashion. 
fU In yet another aspect of the present 

2 0 invention, the video data could be displayed on a video 
display that is operatively connected to a game port of 
a video game box containing a DVD player or similar 
optical disc reader, a central processing unit, and a 
graphics processor unit. 
25 In yet another aspect of the present 

invention, it is possible to designate a destination 
region on the display for displaying the video source 
values to be displayed. If the area of video source 
data does not correspond one-to-one with the area of 
30 the destination region, the video source data is scaled 
in a graphics processor unit. 

A method of operating a video game is also 
set forth and comprises the steps of processing a video 
data stream as generated from an optical disc player 
35 and displaying video data on a video display at a 
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predetermined aspect ratio. A game controller is 
manipulated for continuously scaling images on the 
video display by obtaining video source values of pixel 
width and height to be displayed and determining the 
smallest integer increment on the x/y axis that will 
maintain the desired aspect ratio by using a greatest 
common denominator to reduce the ratio to the lowest 
integer in response to a predetermined manipulation of 
the game controller. 

A video display system is also set forth and 
includes a central processing unit and associated 
graphics processor unit for processing a video data 
stream and generating video data to be displayed. A 
video display receives video data and displays a video 
image at a predetermined aspect ratio. A user 
manipulable controller is operative with the graphics 
processor unit for scaling images on the video display 
by obtaining video source values of pixel width and 
height to be displayed and determining the smallest 
integer increment on the x/y axis that will maintain 
the desired aspect ratio using a greatest common 
denominator to reduce the ratio to the lowest integer. 

In another aspect of the present invention, 
the video display comprises a television. An optical 
disc reader, such as a DVD (digital versatile/video 
disc) player, is included as part of a video game 
system for producing the video data stream. The video 
data stream can also comprise a high definition 
television (HDTV) signal. A user manipulable 
controller can include one or more joysticks. 

Brief Description of the Drawings 

Other objects, features and advantages of the 
present invention will become apparent from the 
detailed description of the invention which follows, 



when considered in light of the accompanying drawings 
in which: 

FIG. 1 is a high level block diagram of a 
video display system as part of a video game system in 
accordance with the present invention. 

FIG. 2 is a high level flow chart 
illustrating a basic method of scaling images in 
accordance with the present invention. 

Detailed Description of the Preferred Embodiments 

The present invention will now be described 
more fully hereinafter with reference to the 
accompanying drawings, in which preferred embodiments 
of the invention are shown. This invention may, 
however, be embodied in many different forms and should 
not be construed as limited to the embodiments set 
forth herein. Rather, these embodiments are provided 
so that this disclosure will be thorough and complete, 
and will fully convey the scope of the invention to 
those skilled in the art. Like numbers refer to like 
elements throughout . 

The present invention advantageously provides 
an advantage over prior art "stepped" scaling and zoom 
functionality common with consumer DVD players, video 
game systems using optical disc players such as DVD 
players, and similar video systems that receive a video 
data stream resulting from a DVD or optical disc 
player, high definition TV (HDTV) signal, or other 
similar video production system. Many prior art 
systems were limited and operative by pressing a zoom 
button on a game controller or other system that would 
magnify by twice or by some other arbitrary resolution 
the current view displayed on an LCD or video display 
screen. For example, if a viewer is viewing 720x480 
pixels of source content on a 720x480 display, when the 
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viewer hits the zoom button, the viewer would then view 
360x240 pixels of source content, scaled to fit on the 
720x480 display. Sequential depression of the zoom 
button would increment the zoom level by the same 
5 arbitrary magnification level- In another prior art 

"stepped" zoom functionality system, a pan-able bracket 
[] was displayed on the screen, designating the area 
that would be zoomed to full screen upon the next 
pressing of the "ENTER" button. This method also 

10 allowed the increase of the magnification level by a 

. fixed arbitrary amount. 

Drawbacks of these two types of prior art 

M 

□ systems are that the systems did not allow a user to 

O 

fit 
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pan the zoomed image in "real-time, " and did not 
15 provide a user with the means to increase or decrease 



the zoom level in a perceptably continuous fashion. 
Ly The present invention advantageously allows a 

continuous zoom feature for use with a displayed video 
image, such as displayed video data as from a processed 
20 video data stream resulting from a DVD or HDTV viewer 
driven by a multi-directional controller, for example, 
a pair of joysticks of a game pad controller or other 
similar controller . 

Scaling can be accomplished on a graphics 
25 processor unit (GPU) . When a zoom function occurs, 

such as by manipulating a game controller or joystick, 
the coordinates of the source data one wishes to 
display is set and a destination area for display is 
designated, for example, on a full screen 640x480 pixel 
3 0 display. If the area of the source data does not 

correspond one-to-one with the area of the designation 
region, the graphics processor unit can scale the data 
in hardware. Although it is possible to use software 
scaling, it is more CPU intensive, as in the use of 
35 other common prior art software scaling systems that 



make intensive use of software algorithms and CPU 
resources. The present invention is also applicable 
for maintaining an aspect ratio in some given regions, 
which does not need to be fractionally scaled, giving 
visibly better results in these instances. The scaling 
is used in a continuous fashion and can be zoomed and 
panned simultaneously and optimized for stability. 

The present invention can first be operable 
by viewing a display that displays DVD or HDTV video 
data at a normal source resolution, as a non-limiting 
example. Naturally, other source video data can be 
used, including, data generated from a hard disc, 
optical disc, Internet, or other source known to those 
skilled in the art. The description proceeds with a 
description relative to a DVD or HDTV viewer because 
these video data streams are presently encompassed in 
the use of many video game systems. 

The DVD or HDTV viewer software can be driven 
by a multi-directional controller, such as a pair of 
joysticks on a game pad controller. At any time during 
normal playback or still playback, a controller with 
X/Y coordinates is moved to vary continuously the 
current zoom magnification. For instance, moving a 
joystick up could increase the zoom magnification by a 
very small number of pixels, while moving a joystick 
down could decrease the zoom magnification until it is 
fully zoomed out. If a second joystick is available on 
the game controller or in a game pad, this control 
could vary the X/Y position of the zoomed region in a 
continuous fashion . 

The present invention also provides a novel 
and unobvious zoom feature in a consumer DVD or HDTV 
playback device and provides a smooth centering 
algorithm that ensures a zoomed rectangle always 



retains its perspective with relation to the entire 
source and minimizes jitter or "bob" effects. 

Although the description will follow with 
reference to a DVD player, it should be understood that 
any video data stream can be processed, including data 
streams produced by compact disc, video disc, tape, 
cassette, or other digital video data stream. DVD has 
become more common for containing video data with its 
seven- fold increase in data capacity over CD by 
tightening tolerances throughout the system. Other 
aspects of the present invention regarding the aspect 
ratio are known to those skilled in the art. The use 
of joysticks and game ports are commonly known to those 
skilled in the art. The term "high definition 
television" (HDTV) refers to the several methods for 
obtaining greater detail into a television picture that 
is an improvement over the more conventional National 
Television Systems Committee (NTSC) TV signal. 

Referring now to FIG. 1, there is shown a 
video display system 10 as part of a video game system 
12 using the method and system of scaling images 
continuously on a video display 14 in accordance with 
the present invention. Although many different types 
central processing units (CPU) , graphic processing 
units (GPU) , chip sets, memory devices, bridges, slots, 
frame buffer circuits, and other game and video display 
and system architectures could be used in accordance 
with the present invention, the present invention is 
described relative to the video game system 
architecture shown in FIG. 1. 

As illustrated, the video game system 12 
includes a central processing unit 16 and a chip set 18 
with associated support circuits that provide signals 
for the microprocessor and link the various systems and 
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peripherals. A main memory 20 is operatively connected 
to the chip set 18. Various slots 22, known to those 
skilled in the art, such as PCI slots and ISA slots, 
are connected into a bridge 24, such as a PCI bridge, 
5 as illustrated. A graphics processing unit (GPU) 26, 
such as an NVIDIA graphics processing unit, is 
operatively connected to the chip set 18 and includes 
in the illustrated embodiment an advanced graphic port 
28 and a frame buffer 30, as known to those skilled in 
10 the art. The advanced graphic port 2 8 incorporates 

dedicated, pipeline access to main memory via the chip 
H' set 18 or other means known to those skilled in the 

A' SB, 

art. It can move data between a dedicated frame buffer 
30 and main system memory 20. Various expansion cards 
ftj 15 can be included as requested by a user or those skilled 

in the art . 

A controller 32, e.g., a game controller, is 
operatively connected to the CPU 16 and graphics 

\ processing unit 26 via the slots 22, PCI bridge 24 or 

\ iJ 

q 20 game port 34, as illustrated. The controller 32 

r includes a joystick, and in the illustrated embodiment, 

two joysticks 36, 36a. A DVD player 38 is part of the 
overall system and typically included in one video game 
housing 40 that contains most or all system components. 
25 The DVD player 38 is driven by appropriate DVD software 
drivers, as known to those skilled in the art. An 
ethernet port 42 is included and a high definition 
television (HDTV) port 44 for receiving HDTV signals or 
generating HDTV signals with the graphics processing 
30 unit 26, as known to those skilled in the art. 

The video display 14 could be incorporated 
integral with the system or be connected via wireless 
or wireline connection through a video output port 46 
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to a television, HDTV, LCD or other video display, as 
known to those skilled in the art. 

FIG. 2 illustrates a basic high level flow 
chart illustrating the method and system of the present 
invention. The system is described relative to 
operating a video game. 

A video data stream is generated from an 
optical disc player such as the illustrated DVD player 
(FIG. 1) and processed (Block 100) . Video data is 
displayed on a video display at a predetermined aspect 
ratio (Block 102) . 

A game controller, such as a joystick, is 
manipulated (Block 104) . Video x/y source values of 
pixel width and height to be displayed are obtained 
(Block 106) . A destination region on the video display 
is designated for displaying the video source values to 
be displayed (Block 108) . The smallest integer 
increment on the x/y axis that will maintain the 
desired aspect ratio is determined by using a greatest 
common denominator to reduce the ratio to the lowest 
integer (Block 110) . If the area of video source data 
does not correspond one-to-one with the area of the 
destination region, the video source data in the 
graphics processor unit is scaled (Block 112) . 

Scaling can occur by calculating a new width 
and height as in current pixel width and height and 
width and height increment to be displayed and fixing 
an x and y position as fixed x and y center points 
minus or plus any respective new width and height 
divided by two (Block 114) . The system zooms to the 
newly calculated coordinates of source content (Block 
116) . 

A representative pseudo code is set forth 
below and shows the functional algorithm in high level 
format : 
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// first get the source video width and height 
GetSourceVideoDimensions(&sourceWidth, &sourceHeight); 

// now, using the source values, determine the smallest increments that will 
maintain the correct 

// aspect ratio by using greatest common denominators, thus allowing smooth 
scaling 

ReduceRatioToLowestIntegers(sourceWidth, sourceHeight, &XzoomIncrement, 
Yzoomlncrement) ; 

If (joystickMoved) 
{ 

if (ZoomingOut) 

{ 

15 // check for maximum limits 

if ((CurrentOutput Width + Xzoomlncrement < Maximum Width) 

&& 

^ (CurrentOutputHeight + Yzoomlncrement < MaximumHeight)) 

ru < 

|»t 2 0 New Width = CurrentOutput Width + Xzoomlncrement 

FU NewHeight = CurrentOutputHeight + Yzoomlncrement 

W Xposition = FixedXCenterPoint - NewWidth/2 

* Yposition = FixedYCenterPoint - NewHeight/2 

[7 // zoom to newly calculated coordinates of source content 

nj Zoom(Xposition , Yposition, NewWidth, NewHeight) 

Q > 
N- } 

3 0 else 



// zooming in 
{ 

3 5 // check for maximum limits 

if ((CurrentOutput Width - Xzoomlncrement > Minimum Width) && 
(CurrentOutputHeight - Yzoomlncrement > MinimumHeight)) 

{ 

NewWidth = CurrentOutput Width — Xzoomlncrement 

4 0 NewHeight = CurrentOutputHeight - Yzoomlncrement 

Xposition = FixedXCenterPoint - New Width/2 
Yposition = FixedYCenterPoint - NewHeight/2 



45 



// zoom to newly calculated coordinates of source content 
Zoom(Xposition , Yposition, NewWidth, NewHeight) 

} 
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5 A more detailed code written in C++ is set 

forth below as a representative example of the type of 
code functionally that can be used for the present 
invention, as a non- limiting example. 
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[? 15 && (domain != DVD^DOMAIN^Stop)) 



if(m_bLThumbStickOn) 
{ 

DVD DOMAIN domain; 

if (S_OK == m_pPlayer->GetCurrentDomain(&domain) 



*y WORD wX, wY; 

\a float fScaleFactor; 

fU if(S_OK = 

CO 2 0 m_pPlayer->Get_CurrentScaleFactor(fScaleFactor)) 
W " { 



ru 

m 25 

p[ (1.0/fScaleFactor)); 

(1.0/fScaleFactor)); 



30 



(m_fLThumbStickX >= 0.75)) 



m_pPlayer->Get_VideoSize(wX, wY); 
fScaleFactor = max(l, fScaleFactor); 
WORD xRange = (float) wX * (1.0 - 
WORD yRange = (float) wY * (1.0 - 

if ((m_fLThumbStickX <= -0.75) || 
{ 



mnZoomX = (mfLThumbStickX 
3 5 <= -0.75) ? m_nZoomX - ZOOM_X_INCREMENT: 

mnZoomX + 

ZOOM_X_INCREMENT; 

} 

40 if ((m_fLThumbStickY <= -0.75) || 

(m_fLThumbStickY >= 0.75)) 

{ 

mnZoomY = (mfLThumbStickY 
<= -0.75) ? m_nZoomY + ZOOM_Y_INCREMENT: 



ZOOM_YJQsTCREMENT; 

xRange)); 
yRange)); 
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m_nZoomY - 

m nZoomX = max(0, min(rn_nZoomX, 
m_nZoomY = max(0, min(m_nZoomY, 

ResetCenterPoint(); 



HRESULT hr = 

m_pPlayer->Trick_Zoom(m_nZoomX, m nZoomY, m_nZoomW, m_nZoomH); 

> 

> 

} 

if(m_bRThnmbStickOn) 

{ 

DVD_DOMAIN domain; 

if (S_OK = m_pPlayer->GetCurrentDomain(&domain) 
&& (domain != DVD_DOMAIN_Stop)) 

{ 

if ((m_fRThumbStickY <= -0.75) || 
(m_fRThumbStickY >= 0.75)) 

{ 

// calc x and y zoom increment based on w/h 

ratio 

// this assures we get a smooth zoom with as 

little bob as possible due to scaling 

WORD wX, wY; 

m_pPlayer->Get_VideoSize(wX, wY); 

if (!m_nZoomW) // width/height not yet set 

{ 

m_nZoomW = wX; 
m_nZoomH = wY; 

} 

// reduce the w/h ratio and use a multiple of 

those numbers as the base increment 

int wNum, wDen; 

ReduceRatio(wX, wY, wNum, wDen); 

UINT nZoomYInc = wDen * 4; 
UINT nZoomXInc = wNum * 4; 
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30 



35 



40 



45 



maximum is full width 
-0.75) ? 

nZoomXInc * 2); 

maximum is full height 

? 

nZoomYInc * 2); 



pans 

( ! m_CenterPoint.y)) 

(m_nZoomW / 2.0f); 
(m_nZoomH / 2.0f); 

xRange)); 
yRange)); 
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// minimum width is 2 x Increment, 
m_nZoomW = (m_fRThumbStickY <= 

min(m_nZoomW + nZoomXInc, wX) 
max(m_nZoomW - nZoomXInc, 

// minimum Height is 2 x Increment, 
mnZoomH = (m_fRThumbStickY <= -0.75) 
min(m_nZoomH + nZoomYInc, wY) 
max(m nZoomH - nZoomYInc, 

// x position depends on our new width 
WORD xRange = (float) wX - m_nZoomW; 

// y position depends on our new height 
WORD yRange = (float) wY - mjiZoomH; 

if (0 = xRange) 

ResetZoomVariables(); 

else 

mbZoomed = true; 
// maintain the fixed center point until user 
if ((!m_CenterPoint.x) && 

ResetCenterPoint(); 
m_nZoomX = m_CenterPoint.x - 
mnZoomY = mCenterPoint.y - 

m nZoomX = max(0, min(m_nZoomX, 
mnZoomY = max(0, min(m_nZoomY, 



HRESULT hr = 

m_pPlayer->Trick_Zoom(m_nZoomX, m_nZoomY, m_nZoomW, m_nZoomH); 
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Many modifications and other embodiments of 
the invention will come to the mind of one skilled in 
the art having the benefit of the teachings presented 
in the foregoing descriptions and the associated 
drawings. Therefore, it is to be understood that the 
invention is not to be limited to the specific 
embodiments disclosed, and that the modifications and 
embodiments are intended to be included within the 
scope of the dependent claims. 



